Training the next generation of learning health system scientists.

Introduction: The learning health system (LHS) aligns science, informatics, incentives, stakeholders, and culture for continuous improvement and innovation. The Agency for Healthcare Research and Quality and the Patient-Centered Outcomes Research Institute designed a K12 initiative to grow the number of LHS scientists. We describe approaches developed by 11 funded centers of excellence (COEs) to promote partnerships between scholars and health system leaders and to provide mentored research training. Methods: Since 2018, the COEs have enlisted faculty, secured institutional resources, partnered with health systems, developed and implemented curricula, recruited scholars, and provided mentored training. Program directors for each COE provided descriptive data on program context, scholar characteristics, stakeholder engagement, scholar experiences with health system partnerships, roles following program completion, and key training challenges. Results: To date, the 11 COEs have partnered with health systems to train 110 scholars. Nine (82%) programs partner with a Veterans Affairs health system and 9 (82%) partner with safety net providers. Clinically trained scholars (n = 87; 79%) include 70 physicians and 17 scholars in other clinical disciplines. Non-clinicians (n = 29; 26%) represent diverse fields, dominated by population health sciences. Stakeholder engagement helps scholars understand health system and patient/family needs and priorities, enabling opportunities to conduct embedded research, improve outcomes, and grow skills in translating research methods and findings into practice. Challenges include supporting scholars through roadblocks that threaten to derail projects during their limited program time, ranging from delays in access to data to COVID-19-related impediments and shifts in organizational priorities. Conclusions: Four years into this novel training program, there is evidence of scholars' accomplishments, both in traditional academic terms and in terms of moving along career trajectories that hold the potential to lead and accelerate transformational health system change. Future LHS training efforts should focus on sustainability, including organizational support for scholar activities.

"Black People Like Me": A virtual conference series to engage underserved patients with asthma in patient centered outcomes research.

BACKGROUND: In response to racial inequity in asthma, asthma-related research among diverse patients is vital. However, people from historically marginalized groups are underrepresented in clinical and patient-centered outcomes research (PCOR). The "Black People Like Me" (BPLM) virtual conference series was developed to: (1) engage Black patients with asthma and their caregivers in education and discussions about asthma, and (2) encourage involvement in PCOR. Education about COVID-19 and COVID-19 vaccination was also incorporated. METHODS: The Project Advisory Group consisting of Black patients, clergy, physicians, and a program evaluator met monthly to develop BPLM. The program consisted of free one-hour virtual sessions held monthly for 6 months. BPLM was promoted through the Allergy & Asthma Network website, emails, social media, and personal contacts with a recruitment goal of ≥ 100 Black patients with asthma or caregivers. Program evaluations, interactive polling questions during each session, and participant pre- and post-session tests were conducted. RESULTS: Sessions averaged 658 participants including Black patients, family members, caregivers, Black clergy, health care providers, and other concerned community. Overall, 77% of participants strongly agreed with satisfaction with the sessions. Pre- and post-tests demonstrated that participants exhibited growth in knowledge regarding asthma risk, PCOR, and PCOR research opportunities for patients, exhibited preexisting and sustained knowledge regarding COVID-19 vaccination and side effects, and demonstrated an increased sense of empowerment during healthcare visits. CONCLUSIONS: BPLM demonstrated that a virtual platform can successfully engage Black communities. Incorporating clergy and religious organizations was critical in developing the trust of the Black community towards BPLM.

Developing patient-centered outcomes research infrastructure in a rural community through patient and stakeholder engagement and education during the COVID-19 pandemic.

In addition to facing numerous healthcare disparities, rural America is chronically underrepresented in clinical research. This gap was made more evident during the COVID-19 pandemic. St Lawrence Health, located in rural Upstate New York, established its Clinical and Rural Health Research Department in 2015 to help close this gap. The research department then launched the DISRUPTS (Developing InfraStructure for Research to Utilize Patient-centered Techniques at St Lawrence Health System) program to build the infrastructure to conduct Patient-Centered Outcomes Research (PCOR). Together with a diverse committee, the team used proven methods and frameworks to develop a model for engagement, content creation, and education delivery that was successfully used to create educational programs on PCOR and COVID-19. The resulting DISRUPTS webinars had a combined total of over 450 live attendees and over 1,110 views on recordings. Furthermore, nearly one-third of those who participated in the COVID-19 vaccines webinar indicated they were more likely to receive a COVID-19 vaccine after taking part. DISRUPTS can serve as an important model for other rural communities that aim to increase access to and engagement in PCOR, and which hope to improve outreach and education efforts in their communities.

The Impact of COVID-19 on Patient, Family Member, and Stakeholder Research Engagement: Insights from the PREPARE NOW Study.

BACKGROUND: Little is known about the impact of COVID-19 on patient, family member, and stakeholder patient-centered outcomes research engagement. OBJECTIVE: To answer the research questions: (1) What is the impact of COVID-19 on the lives of patients with kidney disease and their families? (2) What is the impact of COVID-19 on research engagement for patient and family member research team members who are themselves at very high risk for poor COVID-19 outcomes? and (3) How can we help patients, family members, and stakeholder team members engage in research during COVID-19? DESIGN: We conducted virtual semi-structured interviews with patient and family member co-investigators and kidney disease stakeholders from the PREPARE NOW study during November 2020. The interview guide included questions about participants' experiences with the impact of COVID-19 on research engagement. PARTICIPANTS: Seven patient and family member co-investigators and eight kidney disease stakeholders involved in a kidney disease patient-centered outcomes research project participated in the interviews, data analysis, and writing this manuscript. APPROACH: We used a content analysis approach and identified the main themes using an inductive process. KEY RESULTS: Respondents reported three main ways that COVID-19 has impacted their lives: emotional impact, changing behaviors, and changes in health care delivery. The majority of respondents reported no negative impact of COVID-19 on their ability to engage in this research project. Suggestions for patient-centered outcomes research during COVID-19 and other emergencies include virtual research activities; active engagement; and promoting trust, honesty, transparency, and authenticity. CONCLUSIONS: COVID-19 has had a significant negative impact on patient, family member, and stakeholder research team members; however, this has not resulted in less research engagement. TRIAL REGISTRATION: Clinicaltrials.gov NCT02722382.

Function and Emotion in Everyday Life With Type 1 Diabetes (FEEL-T1D): Protocol for a Fully Remote Intensive Longitudinal Study.

BACKGROUND: Although short-term blood glucose levels and variability are thought to underlie diminished function and emotional well-being in people with type 1 diabetes (T1D), these relationships are poorly understood. The Function and Emotion in Everyday Life with T1D (FEEL-T1D) study focuses on investigating these short-term dynamic relationships among blood glucose levels, functional ability, and emotional well-being in adults with T1D. OBJECTIVE: The aim of this study is to present the FEEL-T1D study design, methods, and study progress to date, including adaptations necessitated by the COVID-19 pandemic to implement the study fully remotely. METHODS: The FEEL-T1D study will recruit 200 adults with T1D in the age range of 18-75 years. Data collection includes a comprehensive survey battery, along with 14 days of intensive longitudinal data using blinded continuous glucose monitoring, ecological momentary assessments, ambulatory cognitive tasks, and accelerometers. All study procedures are conducted remotely by mailing the study equipment and by using videoconferencing for study visits. RESULTS: The study received institutional review board approval in January 2019 and was funded in April 2019. Data collection began in June 2020 and is projected to end in December 2021. As of June 2021, after 12 months of recruitment, 124 participants have enrolled in the FEEL-T1D study. Approximately 87.6% (7082/8087) of ecological momentary assessment surveys have been completed with minimal missing data, and 82.0% (82/100) of the participants provided concurrent continuous glucose monitoring data, ecological momentary assessment data, and accelerometer data for at least 10 of the 14 days of data collection. CONCLUSIONS: Thus far, our reconfiguration of the FEEL-T1D protocol to be implemented remotely during the COVID-19 pandemic has been a success. The FEEL-T1D study will elucidate the dynamic relationships among blood glucose levels, emotional well-being, cognitive function, and participation in daily activities. In doing so, it will pave the way for innovative just-in-time interventions and produce actionable insights to facilitate tailoring of diabetes treatments to optimize the function and well-being of individuals with T1D. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/30901.

Enhancing community engagement in Patient-Centered Outcomes Research: Equipping learners to thrive in translational efforts.

Community engagement is a critical component of translational research. Innovative educational approaches to support meaningful involvement of stakeholders in clinical research allows for bidirectional learning and greater engagement in translational efforts. Our Penn State Community-Engaged Research Core (CeRC) team has developed an innovative research curriculum for a variety of stakeholders, including patient partners, organizational representatives, and Community Health Workers (CHWs). This brief report will outline unique curricular approaches, guided by adult learning principles, to enhance stakeholder education and engagement in activities. Initial evidence of impact on learning is also reported.

Best Practices for Virtual Engagement of Patient-Centered Outcomes Research Teams During and After the COVID-19 Pandemic: Qualitative Study.

BACKGROUND: Patient-centered outcomes research (PCOR) engages patients as partners in research and focuses on questions and outcomes that are important to patients. The COVID-19 pandemic has forced PCOR teams to engage through web-based platforms rather than in person. Similarly, virtual engagement is the only safe alternative for members of the cystic fibrosis (CF) community, who spend their lives following strict infection control guidelines and are already restricted from in-person interactions. In the absence of universal best practices, the CF community has developed its own guidelines to help PCOR teams engage through web-based platforms. OBJECTIVE: This study aimed to identify the important attributes, facilitators, and barriers to teams when selecting web-based platforms. METHODS: We conducted semistructured interviews with CF community members, nonprofit stakeholders, and researchers to obtain information regarding their experience with using web-based platforms, including the effectiveness and efficiency of these platforms and their satisfaction with and confidence while using each platform. Interviews conducted via Zoom were audio recorded and transcribed. We identified key themes through content analysis with an iterative, inductive, and deductive coding process. RESULTS: In total, 15 participants reported using web-based platforms for meetings, project management, document sharing, scheduling, and communication. When selecting web-based platforms, participants valued their accessibility, ease of use, and integration with other platforms. Participants speculated that successful web-based collaboration involved platforms that emulate in-person interactions, recognized the digital literacy levels of the team members, intentionally aligned platforms with collaboration goals, and achieved team member buy-in to adopt new platforms. CONCLUSIONS: Successful web-based engagement in PCOR requires the use of multiple platforms in order to fully meet the asynchronous or synchronous goals of the project. This study identified the key attributes for the successful practice of PCOR on web-based platforms and the common challenges and solutions associated with their use. Our findings provide the best practices for selecting platforms and the lessons learned through web-based PCOR collaborations.